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Abstract 

In this paper, we consider the problem of partitioning active users in a manner that facilitates multi¬ 
access without collision. The setting is of a noisy, synchronous. Boolean, multi-access channel where K 
active users (out of a total of N users) seek to access. A solution to the partition problem places each 
of the N users in one of K groups (or blocks) such that no two active nodes are in the same block. We 
consider a simple, but non-trivial and illustrative case of AT = 2 active users and study the number of 
steps T used to solve the partition problem. By random coding and a suboptimal decoding scheme, we 
show that for any T > {Ci + ^i) log A^, where Ci and are positive constants (independent of N), 
and can be arbitrary small, the partition problem can be solved with error probability 0 , for 

large N. Under the same scheme, we also bound T from the other direction, establishing that, for any 
T < {€2—^2) log N, the error probability 1 for large N; again C2 and ^2 are constants and ^2 

can be arbitrarily small. These bounds on the number of steps are lower than the tight achievable lower- 
bound in terms of T > (C^ + ^) log N for group testing (in which all active users are identified, rather 
than just partitioned). Thus, partitioning may prove to be a more efficient approach for multi-access 
than group testing. 
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I. Introduction 

For successful payload transmission in networks, resources are needed to coordinate among 
users. A simple example is that of a MAC protocol, in which active users coordinate to avoid 
collision in channel access. 

The Partition Problem: One simple way to achieve this coordination is through the partition 
problem defined below. For integer > 1, let A/" = (1,..., N} and for integer 2 < A < A, let 
Gs = {h, ■ ■ ■, C Af. A solution to the partition problem is a A-partitior(^n = {Bi,..., Bk} 
of Af such that for any 1 < k < K, we have IBiOGsl = 1- That is, every group (or block) Bi 
of n contains exactly one element of Qs- 

One could represent the A-partition 11 as a function z : Af ^ 1C, where K, = {1,...,A}, 
such that z{i) = j if£ i e Bj. In this paper, we will represent this function by a vector z = [z,] 
where Zi = j E fC ifi i G Bj. Thus, a valid partition z for an active set Qs in the partition 
problem satisfies \/i,j E Qs, i j ^ Zi ^ zj. 

Now consider a set of A users from Af sharing a Boolean multi-access channel. Assume K of 
these users from set GsQ-^ are active, seeking to access the channel. If the partition problem 
is solved and each active user i E Gs knows its group number z,, then the K active users can 
successively access the channel exclusively in K data rounds: active user i accesses the channel 
in data round z*. This operation is fundamental to MAC protocols. 

Observe that solving the partition problem does not require an active user to know the identities 
of other active users (as in the case in group testing). Thus, the partition problem, while sufficient 
for multi-access, holds the promise of a more efficient solution than group testing. In this paper, 
we demonstrate this potential of the partition problem. 

The Channel: We consider a slotted, noisy. Boolean, multi-access channel shared by A users 
from Af of which a set Gs of K users are active. For each round t > 1 and user i E Af, 
let Xj f E (0,1} be a flag such that user i writes to the channel in round f iff z G Gs and 
Xi^t = 1- The flag Xi^t is also used to construct a transmission matrix as explained later. In the 
noiseless case, the channel provides (during round t) a feedback The effect of 

observation noise is to alter the channel feedback r/o,t to yt as follows. If r/o,t = 0 then yt = I 

'a iT-paitition IT = {B \,..., Bk} of A is a set of K non-empty subsets of A that satisfies the following conditions: (a) 
for aU 1 < i < j < K, Bi f] Bj = 0 and (b) IJiLi = A. 
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Fig. 1. Noisy multi-access Boolean channel. 


with probability gio and y* = 0 with probability 1 — gio- If ?/o,t = 1 then y* = 0 with probability 
goi and yt = I with probability 1 — goi- Fig. [T] illustrates this model. The channel output for T 
rounds of transmissions is denoted by T-elements vector y = [r/i,..., yrY■ 

Our Approach and Main Results: For any T > 1, T rounds of potential transmissions 
by the N users can be represented by an A x T transmission matrix X = we say 

potential transmission to reiterate that it is only the active users i with x* ^ = 1 that transmit 
in round t. Recall that z = [zi\ where 1 < i < N and Zi E JC denotes a partition of the 
M and that y = [yt] (where I < t < T) denotes the channel feedback over T rounds. Let 
^K-,N — (z G (JC)^ :\/l < k < K, 3zi = A:} denote the set of all possible A'-partitions, consider 
a function g : {0,1}^ x {0,1}^ x (0,1}^ —?• ^k;n- For any given N xT transmission matrix 
X and a sequence of T channel outputs y, the function g(X,y) produces a partition z of J\f. 

Given T > 1, the objective is to design an N x T transmission matrix X and a non-adaptive 
decoding function g a priori such that for nearly every given Qs Q N, when written over T 
rounds, the channel produces outputs y such that 5((X,y) = z is a valid partition of the active 
users. We are seeking the infimum of T over all possible X, g such that for any given Qs Q 
a valid partition z is produced, when N ^ oo. 

In |[T|, Q, we have studied the noiseless channel case, using an i.i.d. Bernoulli random coding 
method to generate entries of X. We modeled information gained towards partition construction 
as a sequence ... ,'Ht of hypergraphs. Here Ho is an A-nodes hypergraph with all 

possible hyperedges of rank K. Each channel output yt induces the removal of hyperedge(s) 
from Ht-i to construct Hf When the hyperedge corresponding to the active set Qs is in the 
resulting hypergraph Ht, and every subgraph of Ht containing this hyperedge is strongly K- 
colorable (distinct colors within each hyperedge), then the active users have been partitioned 
(these colors being their group numbers). A point to note is that hypergraph Ht can be obtained 
from Ht-i using only the round-f channel feedback yt. 
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For the noisy channel considered in this paper, we will still model partition problem from a 
perspective of a strong coloring of hypergraphs. However, l-Lt, the hypergraph for round t, is 
constructed using the entire history of channel feedback yi,... ,yt. The analysis techniques used 
are also completely different from our earlier work |[T|, Q. We propose a sub-optimal strong 
typical set decoding method, and adopt random coding as well as a large deviation technique for 
an induced Markov chain. A more generalized structure is revealed than the extended Fibonacci 
numbers found in noiseless case, which could be potentially extended to solve more general 
cases with K > 2 active users. It is shown there is a gap between C 2 and Ci (the constants 
associated with the upper&lower bounds on time T) under this scheme, which implies that there 
is room for further improvement. 

Prior Work: The partitioning problem has a close relationship to conflict resolution 0 and 
group testing Q (or compressed sensing 0) problems. Conflict resolution involves directly 
scheduling a transmission matrix Xcr (subscript cr is for conflict resolution) for at least one 
slot so that each active user has its exclusive access to the channel. Note that the resulting 
transmission order of active nodes is not known to the users, only success of the transmission is 
ensured. Group testing also schedules a transmission matrix Xg such that set of active users 
is exactly determined from the feedback y; i.e., states of all users are identified. Our partition 
reservation system and group testing can both be used as a reservation step that assigns distinct 
transmitting orders to active users. Subsequent to this reservation stage, just K slots of packets 
size are needed for active users to transmit their packets without conflict; in the reservation 
stage, however, the size of a time slot can be much smaller (just a bit). In contrast, the slots are 
of packet size during the entire process in the conflict resolution approach. We also establish 
that the partition reservation system needs less time than group testing, as it solves a weaker 
problem. 

To the best of our knowledge, Hajak first realized the nature of conflict resolution is to 
partition active users to different groups 0, 0, and derived an achievable bound as partitioning 
information, without considering channel and transmission effects. The converse problem, which 
is close to a zero-error list-codes or perfect hashing problem is still an open problem; it was 
discussed by Hajak, Korner, Arikan, et al, [|9]|-[fT^, and Korner and Orlitsky in (T^ Chap. 
V]. These previous works on partition information are from the source coding perspective; i.e., 
representation of users’ states using partition information. In contrast, we focus on construction 
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of a partition relationship among active users by their explicit transmission over a collision and 
noisy Boolean multi-access channel. This problem has not been addressed previously. There are 
various approaches on non-adaptive conflict resolution and group testing for a Boolean multi¬ 
access channel; these methods are either combinatoric or probabilistic. These include overviews 
0, |fT4||, p3]|, and specific approaches including superimposed codes p^-p9||, selective families 


broadcasting problem pT] , and other methods p2||-p4]|. It should be noted that recently 
0 the group testing problem has been reformulated under an information theoretical framework 
to study the limits of restoration of IDs of active nodes over noisy Boolean multiple access 
channel. Noisy group testing is also discussed in Chan, et al. p5] | and Malyutov p6] |. 

Our work also has a significant impact on the understanding the limits of partitionability of 
interacting users in distributed systems. It has varies of applications. First, as stated before, 
it can be applied in the reservation stage of conflict resolution. Second, since the partition is 
obtained by all users, more complicated coordination is available for users to achieve better 
efficiency and more functions of the system. An example is that beside conflict resolution in 
time domain, the active users can avoid conflict in time-frequency domain, if they are assigned 
different orthogonal time-frequency codes according to the partition. Moreover, it could find use 
in other applications, including distributed multi-channel assignments, clustering, leader election, 
broadcasting, and resource allocation. [|20||, [|27||-[|29|. 


The rest of this paper is organized as follows. First, the problem is formulated in Section 


A hypergraph strong coloring approach to decoding is presented in Section |IIIj For the case with 
K — 2 active users, the sufficient condition of time T needed to obtain the desired partition is 


derived in Section while the necessary condition under the same random coding and sub- 
optimal decoding framework is derived in Section |Vj We compare our results with that of group 
testing in Section |V^ Section |VII| concludes the results. 


II. System model and random coding 

A. Formulation 

We further introduce some notation. In this paper, lower-case (resp., upper-case) boldface 
letters are used for column vectors (resp., matrices). For example, w = [tWj] denotes a vector 
with Wi as the z-th element, while W = [wij] denotes a matrix with element Wij in row i and 
column j. We use natural logarithms to base e. Symbols A and V are used to represent AND, 
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Fig. 2. Example of the formulation. (N = 4, X = 2, = {1, 2} means the and 2^^ users are active, the number of time 

slots is T = 3.) 


OR between events, for example, B AC denotes an event in which both B and C occur. These 
symbols are also used to represent logical AND and OR operations between Boolean operations, 
for example, 1A0 = 0, 1V0 = 1. The probability of a random variable A having value A is 
denoted by Pa{A) = Pr(A = A). Similarly, pa\b{M^) — Pr(^ = 4|S = B). Where there is 
no danger of ambiguity, we will drop the subscripts and simply write p{A) or p{A\B) to denote 
the above quantities. 

We assume that K is known. We use a Boolean vector s = [si,..., sjv]^ to represent the 
active states of users, i.e., s, = 1 iff z e Qs, recall that Qs — {zi, • • • Ak} is the set of active 
users. Denote by Eik-n — (s G {0,1}^ '■ ~ -^1 possible vectors s for K 

active users. Active users use T time slots to transmit according to x T transmission matrix 
X and observe the feedback y. Using these, the nodes obtain the A-partition z = 5 f(X, y). 
Assume that there is stationary, memoryless, observation noise in the channel under which the 
relation between yt (noisy channel feedback) and yoz = ViG& ^i,t (noise-free channel feedback) 
is captured by the conditional probability Pyt\yQt{yt\yot), ns shown in Fig. Recall that only 
active users z with x* j = 1 writes to the channel in round t. Therefore, the sequence of values 
collectively written to the channel (without the effect of noise) is yo = ® s = [\/j (a:* ^ A Sj)]- 

There are two dimensions in this problem, the user dimension N and time dimension T. 

The partition problem can be illustrated by an example in Fig. user 1 and 2 are active, after 
transmission according to X, the feedback y is observed instead of yo due to the presence of 
noise; a common partition [1 2 1 2]^ is obtained by some decoding function y, it is a correct 
partition since active users are assigned to different groups. 
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Fig. 3. Encoding-channel-decoding system with distortion criterion 


The partition problem can be treated as a coding problem in a multi-access channel from the 
information theoretic view as shown in Fig. Consider N users with active states s as N inputs 
to the system. The i-th row of X, denoted by (xj is a T column vector), can be viewed as a 
codeword of user i, so that it will send SjxJ on the channel, and the feedback y is the output of 
channel. A distortion function is defined for any status vector s G '^k-,n and a partition vector 
z e I^k-n as follows: 

f 0, if VI < z < j < A, (si = Sj = 1) ^ {zi f Zj) 
d(s,z)=<j . (1) 

I 1, otherwise 

The objective is to design a transmission matrix X (that produces channel output y) and a 
corresponding decoding function z = p(X,y), so that d{s, g(X.,y)) = 0. We use a probabilistic 
model to study the problem in this paper. Assume that every s G has the same probability 
Ps(s) = 1/ (^), consider the average error for a given X and g, defined by: 


s)l(d(s,^(X,y)) f 0) 


pW(X)A p(s)^Py|„(y|XT 

se^N-K y 

where 1 [A) is the indicator function, whose value is 1 when A occurs and 0 otherwise; note that 
we use p(s) instead of Psif)- Recall that we denote by T, the number of rounds over which the 
users transmit on the channel. We say ratio Ci is achievable if when ><^ 1 - 1 -^ (for any 

constant ^ > 0), there exists a matrix X* and g* such that (X 


sufficient condition in terms of the lowerbound of 


log(JV) 


to attain P, 


\og(N) 

0. This is actually a 
(^)(X*) 0. In Section 


IV, we will derive this achievable ratio for the partition problem. 


B. Random Coding 

To find an achievable ratio Ci, we employ a random coding approach by generating each 
Xi^t by independent and identical Bernoulli distribution with probability p = = 1), and 





















use the optimal Bayesian decoding method with risk function = Es[l(d(s, p(X, y)) = 0)]; 
that is, for a realization of X, when observing y, we choose z* = g(X.,y), so that z* = 
arg maXzeZK;iv Es[l(d(s,z) = 0)|y], with proper normalization one may have: 

z* = arg max Wvx(z) (2) 

zeZK-N 

where 

lEy;x(^) = =0)Pyly^{y\X.~^ ®S) (3) 

se^N-K 

If there is more than one z* with the maximum value, we select any one. For notation simplicity, 
we will use p(y|X^ 0 s) instead of Py\yg{y\X.~^ 0 s) in the remainder of this paper. Similarly, 
we use p(y, X"'" 0 s) instead of Py,yo(y, X"*" 0 s). 

Then, the average error over all realizations of X is 

p(N) A^Q(X)POT(X) 

X 

g(X) J]p(y|x^ 0 so)l(d(so, p(X, y)) 7 ^ 0), (4) 

X y 

where (5(X) denotes the probability of generating X. Equality (o) of Eq. Q is due to the 
symmetry in the generation of X, where any particular Sq can be chosen as an input for our 
analysis. We will assume corresponding active set ^so = {1; • • • in the rest of the paper. 
Denote by Pe°°^ the asymptotic value of Pe^\ Since if = 0, there must exist an X* with 
Pe^\x.*) 0. We will seek a Ci so that when T/{log N) > Ci + ^ for any C > 0- then 

Pe°°^ = 0. The optimal Bayesian decoding is quite complicated to analyze. In next section, we 
propose a sub-optimal decoding method to analyze the average error probability from a strong 
hypergraph coloring perspective. 

III. A Graph Coloring Approach for Decoding 

A hypergraph decoding approach is presented in this section. To better understand this method, 
all examples are given in A = 2 case, in which a hypergraph becomes a graph. 
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Fig. 4. An example of the graph view (N — K — 2). 


A. Hypergraph view 

Our decoding method is illustrated in Fig. For a given input sq, the channel output y is 
observed. This output could be different from yo = ® sq due to the presence of noise. A 

possible set of active users with a “sufficiently large probability” generating y can be inferred. 
Let 

Sy = (s e '■ p(y|X^ 0 s) is sufficiently large} (5) 

be the set of all such sets of active users. The idea is to select a z = 5 '(X, y) such that 
Sy n {s : (i(s, z) = 0} is maximized. 

For any given active set represented as vector sq, we now outlines the stages used model 
the transmission and observation of channel feedback, and the construction of a partition z 
corresponding to Sq. 

1) Source: The input s is represented initially as an empty hypergraph Hq = {M, 0) with 
N nodes and no hyperedges. This reflects our initial lack of knowledge about the active 
users. 

2) Transmission and observation: As the active users transmit over the channel using a 
transmission matrix X and the channel provides feedback y, we modify T-Lq by adding 
if-elements hyperedges according to active sets with “sufficiently large probability”. Let 
the new hypergraph be = {M, E'j). 

3) Partition: After T rounds the information obtained so for is in a hypergraph = 
{N, E'rp), as explained before. The decoding process seeks to find the largest sub-hypergraph 
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^ (where = (A/*, E^) and C E'rp) such that is strongly i^-colorable|^ 
Observe that the i^-coloring of gives a K-partition, z of active vector Sq. 

It must be pointed out that the above hypergraph may not correctly partition M with 
respect to Qs^. This error is due to either (a) the hyperedge Qs^ not being present in or 
(b) Qso being deleted from to generate However if T/\ogN is sufficiently large (see 
Section 0. we prove that the decoding is asymptotically error-free. 

Thus, the process can be represented as Hq —)• z corresponding to the expression 

from vectors sq ^ Sy ^ z, as shown in Fig. by an example of N = 6, K = 2. Compared with 
group testing whose objective is to obtain = Et with only one hyperedge our partition 
problem allows and to have more hyperedges to be added, so less effort is needed. This 
translates to higher achievable rate than that of the group testing problem. The objective is then 
to design an efficient X, which essentially construct such a from which we can correctly 
obtain and z. 

An observation of the decoding method is that if the real edge ^so ^ definitely we will 
get a z so that d{so, z) = 0; otherwise we may get a wrong partition. Since C “Hj,, we also 
need ^so ^ -E't- 

As noted earlier, unlike the noiseless case 0 . 0 . the hypergraph cannot be constructed 
sequentially for the noisy channel. (In noiseless case, Ho can be seen as a complete hypergraph 
with all X-element hyperedges. For any hyperedge Gs, h will be deleted from Ht-i to obtain 
Ht if either condition is satisfied at round t: when yt = 1 , no users in Gs transmits 1 ; or when 
yt = 0, at least one of the users in Gs transmit 0.) The key reason is that in noiseless case, we 
have Gs e E'j. s e §y, (note that y = yo, and yo = 0 sq), so we always have the 

real hyperedge ^so in but in noisy case this is not satisfied, so that ^so naay be not in 
Thus, the aim is to ensure for given y, the generated hypergraph = {Af, E'rp) satisfies for 
any input s, 

Gs G Erp S G Syg. (6) 

asymptotically. 

hypergraph is strongly AT-colorable iff there exists an arrangement of K colors to nodes, such that no hyperedges contains 
two nodes of the same color. 
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B. A Suboptimal decoding method 


By adopting the strong typical set decoding approach [ |3l] |, we can develop a joint edge 
construction method. Define a strong typical set , for any a = {w, wq) E (0,1}^, and a small 
constant e > 0, 

[ [y,yo]e({o,i}Y: ] 

= I [y,yo]) -Py,j/o(«)| < f, if Py,yo(«) > 0 f 

[ N {a\ [y, yo]) = 0, if Py,yoia) = 0 J 

where for any collection of L Boolean T-bit vectors [wi,..., w^] E ({0,1}^)^, and a pattern 
a E {0,1}^, N (a| [wi,..., w^,]) denotes the number of times of having pattern a in the sequence 
• • •, WL,t)}J=i- And more specially, 


Py,yo{a) =Pyt,ymiw,Wo) 


{ P2/t|yot(«^|l)(l-(l-p)^)> Wo = l 
P2/t|yot(«^|0)(lnJo = 0 


( 8 ) 


Thus, is the strong typical set that sample frequencies are close to the true probability values. 

The joint edge construction is first, choose a small e > 0; then for a given X, construct 
by: 


G Erp iff 


y, V 

. i&Gs 


e£ 


(9) 


Because of the feature of strong typical set, when T ^ oo, intuitively @ almost surely holds 
for all X and the resulting y, thus we will use this joint criteria to construct 'Hj. instead of 
the sequential method in the noiseless case. It’s a general method which is equivalent to the 
sequential approach in the absence of noise. 

The following steps express the action performed collectively by the active users in partitioning 
Qs with y. We note that this is not an algorithm, just an illustration of the functional steps of 
transmission and decoding. 

Joint edges construction decoding: 

1) When observing y, all users construct by the rule that E E't iff [y,Vie&xJ G £J-, 

2) Determine C by deleting the minimum number of hyperedges from such that 
Hx is X-strongly colorable, the output z is a X-strong colouring of Hx- 
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Remark 3.1: Optimal Bayesian decoding tries to find the maximum z for fFy;x(z) defined in 
0, while our proposed joint method try to maximize: 



( 10 ) 


i.e., we replace the weight p(y|X^ (g) s) in Bayesian decoding by quantizing it into {0,1} 


according to the strong typical set . Thus, the proposed method is optimal when there is no 
noise, but suboptimal in the presence of noise. However, it has explicit geometric meaning in a 
hypergraph view which further enables us to derive an achievable bound based on an induced 
Markov chain, as shown in next two sections. 

C. Simplification for K = 2 case 

Before giving the main result of K = 2 case, we first observe that the hypergraph Hq, 
are now graphs. We will provide a sub-optimal analysis to further simplify the calculation 
of Pe^\ The proposed decoding method includes two steps: to construct to find and z. 
First, a G {0,1}^ imports four constraints on the construction of using (see Eq. Q). These 

constraints are correlated, since ((t(j,t(Jo)| [Y; ~ reduce the 

number of constraints by selecting only two of them a = (w, wq) with w G {0,1}, wo = 0 as the 
constraints. Strictly speaking, assuming 0 < Py^y^ (a) < 1, since Py{w) — Py^y^ {w, 1) +Py,yo (w, 0), 
we have the following sufficient constraints for Eq. 0 by selecting e = 2e, 



^A^((l,0)|[y,Xi Vxj]) -py^yfil,0) < i/4 and 
^Ar((0,0)|[y,Xi Vxj]) -Py,yo(0,0) < e/4, 


( 11 ) 


and necessary constraints for Eq. 0 with e = ^e. 



{i,j) G E't [y,Xi V Xj] G 8'^ 

1 , . . . . 



< e/4, Vt(J G {0,1} 


( 12 ) 
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We will use these two constraints to analyze the sufficiency or necessity instead of Eq. Q. 
Actually these two constraints are approximately equivalent (up to a constant multiplying e). 
As we are primarily interested in the conditions under which Pi"’ ^ 0, rather than how fast it 
approaches 0. Once y is given, we can divide time slots into two blocks = {t ■. yt = w},w ^ 
{0,1} based on the value of yt, and define T"” = \T'^\ as the number of slots in each block; we 
also separate each codeword Xj into two blocks: xf” = [xi^t]{teT'^}^ ^ ^ {0,1} according to the 
indices of [yt]teT^, and A^((t(j,0)|[y,Xi V x^]) = A^(0|[xf V xJ]) = A^((0,0)|[x^,xJ]), because 
xf^ V xj^ = 0 iff xf^ = 0, xj^ = 0. Thus we have: 


ihj) e Ej 


y G SE and [x,^x]] 


G and 


[x-,x°] G 


(13) 


where 


= |y e {0, ir : 


-A^((0,0)|y) -Pj,(w) 


< ^74} 


^w,e 


[xi,X 2 ] G ({0, 




< e/4 


, w G {0,1} (14) 


We note that the implication of Eq. ( [T4l ) can be reversed with e = e (as in Eq. ( [TT] ) and ([T^). It 
means given y, we can separately check y and the codewords in and T° by ( [13] ) to construct 
H't. Note that by Eq. (j^ we have Py,yo{l, 0) = (1 - pfqw, Py,yo{Q, 0) = (1 - pf{l - qw). 

Remark 3.2: The physical meaning of ( [T^ is that given y satisfying ( fT^ , for each edge 
in block T^, we count the number of times that {yt, Xi^t V xj^t) = (1,0), and in block T° count 
the number times that {yt, Xi^t V Xj^t) = (0,1). If they are close to 0)r and Py,yo{0,1)T 

(note that Py^y^{0,l)T = {py{0) — Py^yQ{0,0))T), the edge {i,j) is in 'H'j,, otherwise not. This 
is shown in Fig. Note that when there is no noise, these two numbers should be zero, that’s 
why a sequential construction can be used without noise, and why the problem is more difficult 
to solve in the presence of noise and we need to resort to a large deviation technique. 

Another simplification of the K = 2 case is in finding and z. If z is correct, we have the 
following sufficient conditions to achieve an acceptable partition: 

d(so,z) = 0 



Qso G Hrj. contains no 1-odd cycles 


Eq. (o) is obvious since is 2-colorable. For Eq. {b), ii K = 2, is 2-colorable iff 
contains no odd cycles. Now consider one type of odd cycles that contains ^so an edge, called 






14 



Fig. 5. An example of constructing edges in and T°. Here N = 7, and in the cycle the value of Xi^t is shown. In some 
time, the codewords of the real edge {0,1} might have yt ^ a:i,t V X 2 ,t because of the noise. We should count all such times 
in each block to decide if an edge is in Ht or not in noisy case. 


first type of odd cycles, denoted as “1-odd cycles”. Because all odd cycles in should be 
broken by deleting least edges to get if there are no 1-odd cycles in Qso won’t be 
deleted and will be in Thus, to find an achievable rounds of test, we deem decoding is 
correct iff ^so ^ contains no 1-odd cycles for simplification, which is a sub-optimal 

analysis as belows. 

Sub-optimal analysis for joint edges construction decoding: 

1) When observing y, users construct Tj!j, by the rule that [y,Xj V x^] e £j, which can be 
further simplified to y e and [xj,xj] e and [x°,x°] e when considering 
sufficiency, or y G £y^ and [Xj^,x]] G £fl and [x°,x°] G £f\ when considering necessity; 

2) If ^so £ lj!j, contains no 1-odd cycles, the decoding output is correct; otherwise 

it is wrong. 

Since sq is not known in advance, the second step can’t be used in application, thus this 
method is only used for analysis. In the next section we will derive a sufficient condition on 


log A 


to achieve = 0 by this analysis; then in Section 


V 


we derive the necessary condition 


under which will definitely have 1-odd cycles in the framework of Bernoulli random coding 
and this sub-optimal analysis, which shows the limits of performance of this method. 


IV. Main result: Sufficient condition for K = 2 case 


Theorem 1: When K = 2, if > Ci +^for any constant ^ > 0, we have = 0, where 
Cl = 1/maXpC'(p,gio,goi)> and 


C{p, qio, qoi) = PiPi + PoPo, 


( 15 ) 
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Pi =Pyil) = (1 - (1 -pf)il - qoi) + (1 -pfqio, Po =PyiO) = 1 - Pi, and 

fAl-p?qio , \ A(l-p)^(l-gio) , 

(fii = sup A-logp+ , (/7o = sup A-logp+ 

AeR \ Pi J AeR V Po 

P+ = ^(P+ (1 -P)e^ + \/(p - (1 - p)e^)2 + 4p(l - p)). 


We can check when q^ = goi = 0, the result is exactly the same as that in the noiseless 
case in 0. and when qm + goi = 1, or p = 0,1, C{p, gio, qoi) = 0, which means we can’t 
recover the partition with vanishing average error no matter how large T is, since in this case y 
is independent of s. Moreover, it can be seen if in another system (^oi) 9io) = (1 ~ Qoi, 1 — Qio), 
the corresponding p'^ = pi-u,, = Pi-w, Vw G {0,1}, thus C{p, qio, Qoi) and Ci is symmetric 
with the center (qoi,Qio) = (0.5,0.5). 

The complete proof is in Appendix Below is a sketch of the main ideas in the proof. 

1) Assume the real edge ^so = {1,2}, in order to calculate the error probability easily, we 
will consider [y,xi,X 2 ] to be in a strong typical set through the proof: 


[y,xi,X2] e ({0,1}^)^ : 

[y,xi,X2]) - Py,xi,x2{a) \ < jq, Py,xi,x2{a) > 0 > , 

y A(a| [y,Xi,X 2 ]) = 0, Py.xi.xalo) = 0 


(16) 


where o = {w,u,v) G {0,1}^, and Py^^^^^^{w,u,v) = Py^y^{w,u y v)p^{u)p^{v), p^{u) = 
'Px{xi^t = u) is the Bernoulli pdf. Note that it is different from Eq. 0 which is defined on 
[y,Xj V Xj] for any edge since we need more restriction on the codewords of the real 

edge to simplify analysis. If we choose 5 = e, by the sufficient condition of Eq. ( [T3] ), we 
have [y,xi,X2] G Aj =y {1,2} G E'j, and y G which makes the analysis easier. Eor 
simplification of the notation, we will use e instead of e in the rest of this section. Since for any 
event A, 


Pr(A) =Pr(A, [y,xi,X 2 ] G Alf) + Pr(Al, [y,xi,X 2 ] i Aj) 

< max Pr(A|[y, xi, X 2 ]) + Pr([y, xi, X 2 ] ^ Aj) 

[y,Xi,X 2 ]G^^ 

Based on the feature of strong typical set, Pr([y,xi,X 2 ] ^ Aj) —> 0, as T ^ 00 ; and for the 
maximum, when e is small, every element in the typical set is nearly the same. So asymptotically 
[y,xi,X 2 ] G Aj, we consider this condition is held in the following parts, and calculate the 
probability conditioning on a given [y, xi,X 2 ]. Since in this case {1,2} G E'j,, we just need to 
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consider the probability that Tij. contains 1-odd cycles. Assume the probability of existence of 
a particular 1-odd cycle of M vertices in to be Pe-,M, there are — 2)! < N^~‘^ 

such odd cycles and all of them are equiprobable due to the symmetry in generating X. Thus, 
by union bound, we have 


pm < 

M>3,M is odd 


(17) 


By the physical meaning stated in Remark 3.2, we will consider if this particular odd cycle will 
be constructed in block or T^, i.e., Pe;M = Pm ' where p^,w G { 0 , 1 } is the probability 
that the codewords of every edge (i,j) in the particular cycle satisfy [x^,xj] e in block 
by Eq. ([T3]). 

2) In block T^, if a particular cycle ... ,^^- 2 ) is constructed, it means (x]^,X 2 ), 

(x 2 ,xl) ,..., (xl ,x]^) are all in WLOG, let’s consider a particular 1-odd cycle (1, ..., 


M), the cycle is constructed if for any edge {i,i + l}(where i = i mod M, if i > M), the 
number of times in t E that — (0)0) should be closed to (1 —p^qi^T, i.e, 

|2;A’((0,0)|[xl,x)-pj-]) — (1 —pYqw\ < e/4 by Eq. ( fT?) ) for any i. Sum all of them, it suffices to 
show I ^i+T,t) = (0, 0)) - (1 - p)^gio| < e/4 to upperbound plj. 

We can see the states (a:i_f, 2 : 2 , 4 ), (^ 2 ,t) 2 : 3 , 4 ),..., are correlated, actually, the latter 

depends on the former(it seems {xM,t,xi^t) also depends on (xi, 4 ,X 2 , 4 ), but since 2 : 1 , 4 , ^ 2,4 are 
known when given y, it only depends on the former {xM-i,t-,XM,t))- A Markov chain Ct — 
[( 2 : 1 , 4 , 2 : 2 , 4 ), ( 2 : 2 , 4 , 2 : 3 , 4 ),..., {xM,ti 2 ^ 1 , 4 )]^ length M can be constructed for any t G with 
the initial state ( 2 : 14 , 2 : 2 , 4 ) known, and the last states ( 2 :^, 4 , 2 : 1 , 4 ) partially known. Further, for 
different ti 7 ^ ^ 2 , and £42 are independent. Thus, we can construct a Markov chain with 
length MT^ by assembling all {£ 4 } 4 e 7 -i together, as shown in Fig. and denote it as [hn]. It 
is a non-stationary Markov chain and the transition probability is easy to write. 

Then we need to estimate the deviation of the empirical average ]i^-A((0,0)|[/i„]) from (1 — 
p)^qio- By large deviation techniques for Markov chain [32|, we derive an upperbound of this 
probability: 


Pm < Pr 


1 


MT 


Ar((0,0)|[/i„]) - (1 -p)^gio 


< 


< g-(Ar‘-2)piviT 


(18) 


whose error exponent defined as — log(P)/(M — 2 )T is the first term in C{p, goi, f?io)- Note that 
since xi, X 2 are given, there are only M — 2 degrees of freedom for the other M — 2 codewords, 
which explains the (M — 2 ) factor here. 
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t = l 

(Xii,X2^l) = (Wl,Vi) 


t = 2 

(Xj 2 5 ^2,2 ) “ (^2 5 ^2 ) 




\/\/ \/\/ 


\/ 


\/\/ 



user dimension 


user dimension 


Fig. 6. Constructed Markov chain. Special transitions are drawn red. 


2) In block the analysis is the same, now that the particular 1-odd cycle (1, ..., M) is con- 



(1 — p)^(l — gio)| < e/4 for any i. Thus, we can construct the similar Markov chain [h!^ with 
length MT^, and similarly, we will get the result: 


A < Pr ( - (1 - P)"(l - </io) < j) < 


whose error exponent results is the second term in C{p, goi, (Jw), which completes the proof. 

The Markov Chain used in the proof shows the internal correlation structure of the partition 
problem, and it sheds light on a viable approach to solving more general cases with K > 2 
active users to be partitioned. 

V. Necessary condition under the proposed sub-optimal method 

We have found a sufficient condition in terms of an upperbound on to achieve = 0, 
another question to address is about a necessary condition to have = 0 on under the 
same framework. We intend to show by randomly choosing elements of X with Px{l) — p, no 
matter what e we choose in the sub-optimal decoding method, if ^ ^/D(p, qio, Qoi) for 
any ^ > 0, we will have = 1. If p* = argmaxp C{p, qio, qoi), so that Ci = 1/ C{p*, qio, qoi), 
define C 2 = l/D{p*,qio,qoi), then we can see for Pa,(l) = p*, if = 0, we should have 
> C 2 - Comparison between Ci and C 2 shows the room where we could further improve 
the achievability result. 

Since for the proposed sub-optimal analysis, the decoding output is erroreous iff Qso ^ or 
Tirp contains no 1-odd cycle. We will next derive D{p, qio, goi) by considering when in “Hp there is 
definitely a 1-odd cycle of length 3. Denote P 3 = Pr('H^ contains a 1-odd cycle of length 3, or Qso ^ 
H'j’), we have the following theorem. 
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Theorem 2: When K = 2, if elements ofX. are randomly generated by PxiX) = p, for any 
constant ^ > 0 , if < l/D{p,qio,qoi) — no matter how e is chosen, P 3 1 under 

the joint typical sequence based decoding, where 

D{p, qw, qoi) = Pip[ + PoPo^ (19) 

and for w G {0,1}, 

1 / \ 

0 , 0 ) log _^W2\ ~ ‘^Py,x^,x2{w, 1 , 0 ) log {{p + (1 - p)e^) 

Pw AgM \ p -\- p)6 J 

We can see -D(p,gio,Qoi) ^Iso has the symmetry with ( 7 io, 9 oi- The proof is put in Appendix]^ 
The techniques we have employed in the proof are similar as those in the proof of Theorem [TJ 

VI. Comparison 

As stated in the introduction, our partition reservation has close relations to direct transmission 
and group testing. Since the average error considered in direction transmission system is not the 
same as the definition in this paper, we just compare with the group testing. It should be noted 
that group testing has a distinct objective, namely, learning the status of all users, rather an 
acceptable partitioning. 

For K = 2, hy the tight achievable bound derived in Theorem IV. 1 in 0, we can see for 
group testing with p^{l) = p, if > l/Cg{p,qoi,qio) + ^ for any ^ > 0 , = 0 ; on the 

other hand, if = 0 , we must have > 1 /Cg{p, qoi, qio), where 

Cgip,qoi,qw) = min|/(xi,t;x 2 ,t,|/t), 

/(■; ■) is the mutual information, xi^t,X 2 ,t are i.i.d. Bernoulli random variables with probability 
p, and yt is the random variable obeying condition distribution Py\yg{yt\xi^t V X 2 ,t) for given 
xyt V X 2 ,f Define Cg = 1/ maxpC'p(p), it corresponds to the derived Ci and C 2 in this paper. 

Let goi = Qw — Q, which is a symmetric binary channel, we obtain Fig. (since 1/C might 
be zero, we plot 1 /C instead of C in the figure). It is shown for any p,q, Ci < Cg, which 
means less effort is needed for partition problem. Also, we can see the derived lowerbound of 
the ratio C 2 < Ci, which shows there is still room to improve the achievable bound. We believe 
a sharper bound on Ci by, e.g. counting cycles more carefully, should lead us to an improved 
result, which is one of our ongoing works at present. 
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Fig. 7. Compare Ci, Cg and C 2 . 


VII. Conclusion 

In this paper, we study a novel partitioning reservation problem over the noisy Boolean multi¬ 
access channels. We modify the construction process and the sequential decoding process 
in the noiseless case, and propose a general random coding approach and a sub-optimal jointly 
edge construction decoding method to obtain an achievable bound. A large deviation technique 
for non-stationary Markov chain is employed in the proof, which could be extended to study 
K > 2 cases. Also, the derived achievable bound of T > (Ci -|- ^i)log V is better than the 
tight achievable bound in group testing. To study the tightness of this achievable bound, we also 
derive a necessary condition of T so that if T < {C 2 — C 2 ) log V, Pe°°'^ = 1. It shows that the 
derived achievable bound is still able to be improved. The reason is that by union bound, there 
are too many overlapped odd cycles and thus we count vertices and edges repeatedly. This will 
be studied our in future works. 


Appendix A 
Proof of Theorem [H 

Proof: WLOG, we consider 0 < p, gio, goi < 1 and gio -\- qoi f 1, thus the continuity is 
guaranteed. We will show for any chosen e > 0 of the sufficient constraints in (fT3])(we use e 
instead of e for simplification of the notations), if 0 < ^ < C'(p,gio,goi) - ^(e), there is 
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always = 0, where ^(e) > 0 is a function of e and ^(e) 0. Obviously, it is equivalent 

to the Theorem. 

Denotes A. to be the event that contains 1-odd cycles, and A = Nm ({1,2} ^ (recall 
that Py is the set of edges of 1-Cj), since by Eq. ( [T^ , Eq. ( fT^ , [y,Xi,X2] {1,2} G 

and y e Ey,,, we have: 


p(N) < Pr(^'|[y,Xi,X2]) +Pr([y,Xi,X2] ^ 

[y,xi,X 2 ]G^^ 


( 20 ) 


By the features of strong typical set |31|, we have Pr ([y,xi,X 2 ] ^ A, 


i(r) 


T^oo 


> 0. Thus, we 

just need to consider the probability of existence of any possible 1-odd cycle in 'H'j, on the 
condition that [y,xi,X 2 ] G Aj. In the following parts, this condition is assumed to be held. Eor 
better statement, we denote = {t : I < t < T, = {w,u,v)}, and = \T^J. 

Also, denote = Py,xi,x2iw, u, v)T, and T"” = p^T. 


A. Odd cycles for given [y,Xi,X2] G A^ 

Eor simplification, assume N is an odd number. Consider any particular 1-odd cycle of length 
M, there are at most — 2)! < N^~‘^ such odd cycles out of N nodes, and because 

of the symmetry in generating codewords, the existence of any of them in is equiprobable, 
thus WLOG we will select a particular one 'He;M — (1)2,..., M). Denote PM|[y,xi,x 2 ] to be the 
probability that He^M ^ Py, and PM|[y,xi,x 2 ] the probability that P}. contains l-odd cycles of 
length M, by union bound, we have: 


and 


r max Pr(A'|[y,xi,X2])< 

[y,xi,X2]e.4j^ 


E 

M=3,5,...,Ar 


max 

[y,xi,X 2 ]G^^ 


M|[y,xi,X2] 


( 21 ) 


-PAr|[y,xi,X2l < ^Pjvf|[y,xi,x2l ( 22 ) 

By Eq. ( fT3] ), and note that we have already had y G thus 
PM|[y,xi,x2] =Pi'((1,2),(2,3),...,(M,1) G P}.|[y,xi,X2]) 

<Pr (^[x{„x^] G £:f,\Vw|[y,Xi,X 2 ]) Pr (^[x° ,x^] G £0^°, Vw|[y, Xi, X 2 ]) 

■ All ( 23 ) 


which drives us to separately check the codewords in block and T^. 
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B. In 


For = Pr x^] e , Vw| [y, xi, X2] j, we can see the items [x^,, x^] and x^] 

are correlated, so that we can’t separately calculate Pr ^[x^, G \ [y, xi, X2]^ for each w. 
However, we can see [x^_,_i,xi^] only depends on the former item [x^,xi^] , which inspires 
us to adopt Markov chain to model the problem. Before that, let’s further simply the calculation 
by summing up all the requirements of [x^,xi^], VI < tu < M to get a common one: 


x^,x^] G 


-A^((0,0)|[xi„x^]) - {l-pfqio 


< e/ 4 , \/w 


M 


MT 


= (O’O)) “ (1 -P)Vo 


w=i teT^ 


< e /4 ( 24 ) 


Thus, we suffice to find the probability that the pairs sequence [ixl^^tT^};j+it^]i<w<M,teTi satis¬ 
fying Eq. ( | 2 ^ , which is an upperbound of ii\j. 

1) Markov chain: First, note that for any t, 2:2,4), ■ ■ ■, corre¬ 

lated, and if 211,4,2:2,4 are known, the latter depends only on the former: the first component 
should equal to the second one of the former, and the second component is generated randomly 
by Bernoulli pdf with probability p (if the state is not (211,4,2:2,4) or Thus, for any 

t G T\ we can construct a Markov chain 2:2,1), (212,1,213,1), • • •, ( 21 m,i, 211,4)] of 

length M, whose initial state (211,4,2:2,4) is given, and the last state (21^,1,211,4) is partially given. 
Second, for any two chain ^t2-,xi,t2,x2,t2’ ^ ^2, they are independent. Which 

means we can concatenate them together to get a Markov chain with length MT^. Because the 
initial state of each chain Cf,xit,x2t given by (211,4,2:2,4), and there are four possible values of 
(211,4,212,4) G { 0 , 1 }^, we will concatenate Cf,xi,t,x2,t according to the values of their initial states, 
by the order that first (211,4, ^2,4) = ( 1 , 1 ), then ( 1 , 0 ), ( 0 , 1 ) and ( 0 , 0 ) at last, as shown in Fig. 
1 

Denote the obtained chain to be [hn]n=i ^ Markov chain can be seen as a combination of a 
series of subsequences of length M, and can be partitioned into four blocks based on the values 
of the initial states of subsequences (xi,4,215,4) = iu,v) G { 0 , 1 }^, each block has number 

of subsequences. Index possible values of hn to be [( 1 , 1 ), ( 1 , 0 ), ( 0 , 1 ), ( 0 , 0 )]^ = we 

can define the transition matrix n„+i|n — ['?^n+i|n(^il^p]i,i, where 7r„+i|„((i/|/j°) = Pr(/i„+i = 
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iXu,X2,)-- 


CL) 

E 

'-U 








^X,.A \5 X n){x u , X u ) 






time dimension 


Fig. 8. Arrange to a Markov chain. Here G < tJ 2,^2 if ^ ^ j xhe red arrow shows how 


the Markov chain is formed. 


h^\hn = h^)- Thus, it is easy to write: 


n 


n+l|n 


= < 


Tu,V, 

if n = kM, hn+i = {u, v) 


< Cu, 

ii n = kM - 1, \k-i)Mvi = («, v) 

(25) 

n, 

otherwise 



where fc is a natural number. The initial state 7ri((«, t>)) = l{{u,v) = (1,1)), and 
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1 

0 
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0 

1 -p 

0 

1 — p 


This Markov chain is non-stationary, but except for the states transition related to xi^t,X 2 ,u we 
will get n„+i|„ = n as the transition matrix, and actually 11 will be the key factor in this 
problem. 

2) Large deviation calculation: Now we just need to consider 


< Pr ( X] l(^n = (0,0)) 

\ n 


- ^(1 -p)Vo 


T 

- 


(26) 
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which is a problem of calculating a large deviation of the empirical means of a function(l(/i, = 
(0,0))) of a Markov chain [hn], and can be solved by the lemma in Chapter 2.3 in p2| . For 
completeness, we write the lemma here. 

Lemma 1: For any random process [hn\^^i, for any function /(•) and the empirical means 
^ '^n=i fi^n), define the logarithmic moment generating function ofW^: 

A^iX) = logE[e^^^]. (27) 

Ifx = E[W!^] is finite, then for any non-empty closed interval E = [o, h], we have: 

ifx<ca 

(28) 

where: 

A^(x) = sup{Aa; - Aiv(A)} (29) 

agr 

is called the Fenchel-Legendre transform o/Ajv(A). 

Thus, the key problem of is to calculate the Amt^ (MT^X), A^^i (x) and x = E{Wmt^), where 
Wmt^ = 'l2n=i fi^n) for our Markov chain [hn], with the function f{hn) = l(/in = (0, 0)). 
By direct calculation, we have the results: 

Lemma 2: For [hn\ with transition matrix as ( |25] ), we have 

Amt^{MT^X)= TlJogignAM,X)) (30) 

where 


fi'i,i(Af, A) =Jjvf_i(A) + (1 — a) Jm- 2 (A) 

5'i,o(Af, A) = po,i(Af, A) =Jm-i{X) 

5'o,o(Af, A) (Jm-i(A) — p (l — e Jm- 2 (A)) (31) 

P+, p- are the larger and smaller eigenvalues ofU (of rank 2), and 


M _ M 

(32) 

P+ - P- 


a =p+ + p_ = p + (1 - p)e^ 

(33) 

/3 =P+ - P- = \/(2p - af + 4p(l - p) 

(34) 





24 


When e is sufficiently small, 
X =(1 — pY — 


2 3(1 — p) (1 ~ + ^1,0,i) + (3 — 2p)Ti^o,o 


M ' MTi 

> ^{{1 - pfqio +e), qoi + qw<l; 

< ^{{l-pfqw-e), qoi + qw>l. 

So with the lemmas above, we can bound by: 

lAi <Pr {wmt^ G ^ [(1 - pfqw - e, (1 - pfq^ + e] ^ 

goi + 5io<l; 


(35) 


< 




(36) 


To get the expression in the theorem, we will use the continuity to drop the e, and substitute all 
ff, ^ by and which is the value corresponding to e = 0, and use the lemma belows 
to make the result more concise as well. 

3) Concise solution: To get a concise solution, we give a further result: 

7^1 , „ _A (l-p)^gio 


Lemma 3: VM >3, if e = 0, which means Tj ^ ff = T , then for = 


U,V^ 


PI 


we have 


MT 


Proof: Define 




M-2 , 

>—— sup(Aa; -logp+) 

jyj- AeR 


(37) 


FW =w - ( mt ' a ) 


G(A) 


M-2 


M 


(Ax -logp+) 


Due to Lemma 2.2.5 in |j^, F(A) and G(A) are both convex. And we can find by calculation if 
Qio + Qoi < 1. F'(0), G'(0) < 0; if qio + qoi > L F'(0), G'(0) > 0. Which means the maximum of 
F(A), G(A) will locate at A < 0, for gio+^Zoi < ^ind vice versa. Now we consider qw+qoi < 
the other case is the same. We will show if A* = argmax^ G(A), for A* < A < 0, there is always 
F(A) > G(A), which implies the lemma. 
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The convexity of G{X) means G'{X*) = 0, by calculating G'{X), we have: 


A* < A < 0 


^'(A) <0, A < 0 


e"> 


a^V+( 2 p+ -p) 

(1 -p)((l + x^)p+ -p) 


,A < 0 


(38) 


Also since the convexity of log( ), we have: 


-2Xx^ + 5 ] — 


Tu,v log(P«,^) 


U,V 




< log I (1 — X 


l.'^iu,v)j^{0,0)'^u,v9u,v iPo,0 


E 


jii 

(u,'i;)^(0,0) u,v 


+ x^^l (39) 


By ( |38l ) and ( [39l ), we can derive by calculation that F{X) > G{X),\/M > 3, which completes 
the proof for goi + gio < 1- It is the similar for goi + ?io > 1- ■ 

4) Continuity to drop e: By continuity, assume 


sup 

[y,xi,X 2 ]G^|" 


(Mr((l - p)%0 - e)) - A* (MT((1 - p)^q,o)) 


> 0 


we can see ^(e) 0. Note that ^(e) is also dependent with p,qio,qoi, but we don’t write it 

explicitly for simplification. Thus, we can derive from ( |3^ and Lemma 3 that when goi+9io ¥" 

(40) 




C. In 7^ 


For = Pr ^[x°,x^^] G Vt(j|[y,xi,X 2 ]j, since the symmetry, we can solve the prob¬ 
lem directly from case. Consider another noisy environment where q^Q — 1 — qio, and 
goi = 1 — goi- Then easily we can see Vw G {0, l},Pw = 1 — Pw For any given X satisfying 
[y, xi, X 2 ] G Aj and \/w, [x^, xf^] e Se , it is equivalent to that \/w, [x° , G . Thus 


by the definition of in Eq. (|23|), we have 


max (pl/fY = max 

[y,xi,X2]e.4^ [y,xi,X2]e.4^ 


By the upperbound derived for p\j in Eq. ( |4^ , we have: 

where = 


( 41 ) 


tfO a (l-p)^(l-gio) 
PO 
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D. Complete the proof 

From Eq. ( |4T] ) and Eq. ( |40l ), we can upperbound PM|[y,xi,x2] Eq. 

maxpM|[y,xi,X2] < e-("-2)^(Pl‘^l+P0^3-€(e)/2) 

Thus, if < pipi -\-poPQ — C(e), we have 

^^{M-2)T{\ogN/T-{piipi+pQipQ)-^{e)/2) , 1 ^ aT 

M=3,5,... 

S E ^ 

M=3,5,... 

which completes the proof. 


< Y. + Pr([y,Xi,X2] i Ai') 




» 0 


Appendix B 
Proof of Theorem 2 

Proof: Denote A3 the event that contains 1-odd cycle of length 3, for any e in the 
necessity of Eq. (fT^(we use e instead of e for simplifying the notations), we have by considering 
the strong typical set: 

P3 =Pr((A3 V ^so i P't): [y,xi,X2] e Af) +Pr([y,xi,X2] f Aj) 

>Pr(A3, [y,xi, X2] e Aj) (42) 

It can be seen that Eq. ( |42l ) is non-decreasing with e, thus equivalently, we just need to show 
if for any > C 2 + ^(e), where ^(e) > 0 is a function satisfying ^(e) 0, we have 

Pr(A3, [y,xi,X2] G Aj) 1. Further, since 

Pr(A3, [y,xi,X2] G Aj) > Pr([y,xi,X2] G Aj) min Pr(A3|[y,xi,X2]) (43) 

[y,xi,x2]e^|^ 

and for any e > 0, Pr([y,xi,X2] G Aj) 1, so min[y^xj^x2]e.4r Pj'(A3|[y, xi, X2]) is 

considered in the following part, and [y,xi,X2] G Aj is assumed to be held. Since 

/ N 

Pr(A3|[y,xi,X2]) =Pr I X : |J (h'^ contains cycle (l,2,z)^ |[y,xi,X2] 

\ i=3 

= 1 — ^1 — Pr ^X3 : P'j. contains cycle (1, 2, 3)|[y, xi, X2]^^ 

Eq. (a) is because codewords of users are i.i.d. generated, So WLOG we just consider the cycle 
(1,2,3) and the codeword X3. By the sub-optimal jointly decoding method and since y G Ey ,, is 
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already held, it means \/w G {0,1}, [x^,X 2 ], [x^jXg], [x^jXg] G Because [y,xi,X2] G Aj 
means [x^^jX^] G only [x^jXg] and [x^jXg] should be considered. 

Time is separated to 8 parts 7^^^ by the values of {yt, xi^t, X 2 ,t) = {w, u, v), denote = \{t G 

= 0 }| to be the number of slots that x^^t takes value zeros, we have 0 < ^ < T^y, 

and Vw G {0,1}, 


Af((0.0)|K,xa)=<„ + aSi 

Af(( 0 . 0 )||x|',xa)=<„ + a^„ 

Then by the definition of in Eq. 0 . we have: 

|^Ko + «m) -Ps/,yo(«^> 0 )| < ^ 

I T (“^0 + «i!o) - Py,yo 0) | < ; 

Up to a constant factor of e, it is equivalent to: 

^ (®o^o + ^o,i) ~ Py,yo 0) I < ; 


IT 

la^n-a. 


w _ 

1 0 ^ 0,1 


<! 


Denote b- ^ > and: 


bT = <( 


|^(^o!o + ^(^i) -P2/,yo(«',0)| < f; 


t'^Ko-KA / e. 

T — 4’ 

rpW 

0 < 6 "’ < ^ 

^ — ^u,v — T“ ■ 


Thus, 


N-2 


Pr(/l3|[y,xi,X2]) =1 - 1 - HPr (b"' e ^ri[y,xi,X2]) 

\ W =1 

- (1 - 


(44) 


(45) 


(46) 


(47) 


(48) 


We can still use large deviation technique to calculate /U 3 . Now the distribution of a^y is a 
binomial distribution: 


VO < n < Pr(aJ^„ = n) = 


rpw 

' (1 - p) V 

n ' 


(49) 
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and are independent with each other. So the logarithmic moment generating function of b“': 


A^(A)= lim ^logE 


\T\yWTW 


1 _ _ / rpw 

: lim —log JJ ^ j J(^1 

^ PZv log (p + (1 - p)e^“’") 


(50) 


u/\v=^ 

T m 
1! 


where = YmiTw^oo^^, and A = [Ai^o, Ao,i, Ao,o]^- It is easy to see we have the origin 
belongs to the interior of Vyj^x = {A G : A^(A) < oo}, by the Gartner-Ellis Theorem 2.3.6 
in we have: 


1 


liminf — logPr (b” e Sr|[y. X:, xj) > - , mf , _ A;,,(b”') 4 


where 


^^,e(b“') = sup 

AeR3 




A^b”- Y. /J»„log(p+(l-p)e*-) 


-w,e 


uAv=0 


(51) 


(52) 


is the interior of Bj'", and is the exposed point of A^ g(b"^). Further, since for any 
[bi,o,bo,i,KoV ^ we can always find some [Ai,o, Ao,i, Ao,o]^ G so that 

[bi,o, bo^iAafiV =VA^„([Ai^o, Ao,i, Ao,o]''') 

(1 — p)e^"’” 


A 


W 

u,v 


p + (1 — p)e^“'" 


(53) 


uAv=0 


by Lemma 2.3.9 in |32|, we have [fei,o, Vo]^ £ so C which means we can 

calculate the infimum in the lower bound ( |5T] ) in (^Bj^y. 

Because of the continuity, assume the radius of the neighbourhood of p |e=o to be: 


—w,e ' 


sup 

[y,xi,X2]G^^ 


p - inf A;(b“’) 

r.w,e 


= 6(e) 


where 


A;(b"^) = sup 
agr3 


A^b 


A.,_n P'W 


uAv=0 


(54) 


(55) 


B,„ = < 


b” = Ko. (>0.ireK’: 

Q < m < gv.val^W Q < » w < I>,, i , a (»i.i.ci) 

— U,U — 5 — i,U5 u,i — p^ 

l^w — hw _ . 

^1,0 - ^0,1 - p^ 


Uw _ Py,yo('^^^) uw 

^0,0- 


(56) 
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are |g=o, |€=o respectively. 

Denote D{p, qw, qoi) = Pi mfxie(Bi)° At(x^) +po infxOe(Bo)° A^(x°), by Eq. (|^, (|^, asymp¬ 
totically we have 


pIpI >e“^((pi + t)0"fxlsi3i ^l(x^)+€l(e)) + (po+f)(mf^OgBo'^S(^“)+Sl(e))) 

=exp (-T (Dip,q,o,qoi)+m/‘^)) (57) 


where ^(e) > 0 and ^(e) q. Which means there is a c so that = e and c < 
D{p, qw, qoi) + i{e)/2. If MAiAl > f)(^p^ by Eq. we can see 

r( i°g(y-2) e) 

Pr(A3|[y,Xi,X2]) =1 - (l - 


iPOr 


>1 - 


(l-e-T 


T^oo 


> 1 


which is what we intend to show, except that it is D{p, qw, goi) here. 

So the last step is to show D{p, qw, qoi) = D{jp, qw, qoi) in the theorem, which is equivalent to 
showing = iniy^w^Sy, A^(b"’). We just calculate p'l = infbieBi Ai(b^), the other part can be 
easily proved by symmetry. It can be seen if the inf-sup is achieved when Ai^o = Ao,i = Ao,o/2, 
the equation is held. Due to the convexity of A^(b“') with both A G and b“' G (by 
checking their second derivatives), we first let 'i{u,v), ^ = 0 to find the optimal A* for 

any given b^ = (^o,o]’ 


A 


* _ 

1,0 ~ 


= log 


V _^;go_ 

1 — P Pa;i,a;2|j/(1-; 0| 0 ~ q 


>^*0,0 = log 


P __ 

'^-PPxi,X2\y{0,0\l)-alQ 


(58) 

(59) 


Substitute A* to A];(b^), and let ^ = 0, by using the requirement oj o+Q- 0,0 = Pxi,x 2 \yi^: 0|1-)’ 
we can obtain the equation 2Aj; q = Aq q. Thus, when the inf-sup is achieved, we have Ai = A 2 = 
A 3 / 2 , which completes the proof. ■ 
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